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Abstract In the context of Markov evolution, we present two original approaches 
to obtain Generalized Fluctuation-Dissipation Theorems (GFDT), by using the 
language of stochastic derivatives and by using a family of exponential martin- 
gales functionals. We show that GFDT are perturbative versions of relations veri- 
fied by these exponential martingales. Along the way, we prove GFDT and Fluc- 
tuation Relations (FR) for general Markov processes, beyond the usual proof for 
diffusion and pure jump processes. Finally, we relate the FR to a family of back- 
ward and forward exponential martingales. 
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1 Introduction 

One of the cornerstones of statistical physics is the Fluctuation-Dissipation The- 
orem (FDT) ll9l l5Tll66H78l . whereby, for equilibrium systems, response to a small 
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perturbation of the Hamiltonian is related to dynamical correlation. This theo- 
rem rationalizes the famous regression principle of Onsager 07111721 : the decay 
of spontaneous fluctuation cannot be distinguished from the decay of forced fluc- 
tuation. More precisely, suppose we perturb a system in equilibrium at tempera- 
ture T by adding to its time-independent Hamiltonian H a small time-dependent 
term, such that H — > H — k t O. Here, O is an observable and k t is a real function. 
Throughout this paper, we measure temperatures in units of the Boltzmann con- 
stant kg. The FDT asserts that the response of an observable O' is related to the 
two-time correlation function as 



with t > s. In this relation, the brackets, ( ) and ( )', denote expectation in the 
unperturbed and perturbed processes, respectively. Since mid-nineties, this theo- 
rem has been extended to nonequilibrium systems in two related directions. The 
first is the discovery of various Fluctuation Relations (FR) (19 ,32.35 47], the so- 
called Gallavotti-Cohen relation B2II35I . the Jarzynski equality 0471 and the 
Crooks theorem Ifl9l . All of these hold arbitrarily far from equilibrium and can 
be viewed as non-perturbative extensions H361 of the FDT OJ. These relations 
constrain the distribution of entropy production or work performed in the system. 
The second is the extension of the relation (Q} between response and correlation 
in the linear response regime to nonequilibrium states (stationary as well as non- 
stationary), for example, those in glassy systems and soft spin models 1 1 X 2011271 
I58~ll67l and also in relation to broken supersymmetry 0891 . This second direction 
has seen an upsurge in the last three years through formulation of the General- 
ized Fluctuation-Dissipation Theorems ( GFDT), mainly in the works of Seifert 
and Speck in Stuttgart 181ll83ll84l . Baiesi, Maes and Wynants in Leuven 03l4"ll65l. 
and Gawedzki and Chetrite in Lyon and Falkovich in Rehovot 012lll3l[T4l (see, 
also, the works 062II76I ). Moreover, experimental verifications of the GFDT on 
colloidal particle have been done in Lyon 038II39I . 

In the present paper, we revisit, generalize, and unify these FR and GFDT 
by couching them in the language of the kinematics of a general Markov pro- 
cess, without strict mathematical rigor. We show that this language allows el- 
ementary proofs and generalizations of the different GFDT which exist in the 
literature. We also consider a new family of non-perturbative extensions of the 
GFDT which concerns a so-called exponential forward martingale function- 
als II16II77||74| . Finally, we revisit the FR and show their relation to forward and 
backward exponential martingale^. In the process, we prove that a certain version 
of the Crooks theorem and the Jarzynski equality hold for fairly general Markov 
processes, whereas the Gallavotti-Cohen relation for the performed work can be 
violated when the particle is subjected to a Poisson or Levy noise 061 1871 . 

General Markov stochastic processes form an integral part of modeling of dy- 
namics in statistical mechanics. Although largely idealized, they often provide a 
sufficiently realistic description of experimental situations and have traditionally 
served as a playground for both theoretical considerations and numerical studies. 

1 In the following, unless stated otherwise, use of the word martingale alone would mean 
forward martingale. 




(1) 
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In a continuous space (e.g., Slr\ all continuous time Markov processes consist of 
some combinations of diffusion, deterministic motion and random jumps. Markov 
processes corresponding to equilibrium dynamics are characterized by the detailed 
balance property which ensures that the net probability flux between microstates 
of the system vanishes. On the other hand, with nonequilibrium Markov dynam- 
ics, detailed balance is violated and there are non-zero probability fluxes even in 
a stationary situation. For the purpose of characterizing the difference between 
equilibrium and nonequilibrium dynamics, it is interesting to find a vector field, a 
kind of velocity, which vanishes in equilibrium. Such an object was introduced in 
the sixties by Nelson in his seminal work II69II with the notion of current velocity 
that we call here the local symmetric velocity. This quantity is an average of a 
well-chosen instantaneous velocity of the process conditioned to pass through a 
given point. It was shown in 11411 that nonequilibrium diffusive dynamics (without 
the random jumps) takes, in the Lagrangian frame of this velocity, an equilibrium 
form with the detailed balance property and this explains the usual form ([]]) of the 
FDT in that frame, which was observed previously in 1121 . The issue regarding 
the extension of this result to other types of Markov processes is addressed in this 
article in one of the Sections. 

The formulation of the usual FDT ([]]) for some Markov processes is known 
since long time 191151 11781 in physics, but now it has a strictly mathematically rig- 
orous formulation 1125 1 . For the FR, shortly after the earliest articles in the context 
of deterministic dynamics [132 135 J, the fluctuation relations were proved for some 
Markovian dynamics. In [48 ], Jarzynski generalized his relation to time-dependent 
pure jump Markov processes. At around the same time, Kurchan showed in [551 
that the stationary FR hold for the stochastic Langevin-Kramers evolution with 
additive noise. His result was extended to more general diffusion processes by 
Lebowitz and Spohn in [57]]. In l64l . Maes has traced the origin of FR to the 
Gibbsian nature of the statistics of the dynamical histories. Finally, these relations 
were put into the language of stochastic thermodynamics by Sekimoto [82| and 
Seifert l80ll . There exist now many reviews on fluctuation relations in the Marko- 
vian context, like 142U49U61I for pure jump process or lfT0llllU56ll49"ll60l for dif- 
fusion process, but the extension to FR for general Markov process is still under 
debate I6ll87l 

The paper consists of seven Sections and six Appendices. Section 2 sets the 
stage and provides notations by briefly stating definitions relevant to Markov pro- 
cesses. In particular, in Section 2.1, we recall the notions of transition probability, 
Markov generator, stationary state and equilibrium state. In Section 2.2, we in- 
troduce the notion of cotransition probability, cogenerator, current and velocity 
operator . We also elucidate the relation between these objects. Section 3 devel- 
ops the kinematics of a Markov process II69II by defining a set of local derivatives 
and local velocities associated with such processes. It is proved in Section 3.2 that 
these local derivatives appear naturally in the time derivative of correlation func- 
tion which appears on the right hand side of the FDT (Q]). Section 4 investigates 
the form of the kinematics elements, local velocities and velocity operator, for the 
three most common examples of Markov process which appear in physics. First is 
the pure jump process in Section 4.1, which is a process with no diffusion and de- 
terministic evolution. Second is the diffusion process, considered in Section 4.2, 
which is a process that, on the contrary, neglects the random jumps. Finally, in 
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Section 4.3, we investigate the less considered case which mixes diffusion, ran- 
dom jumps and deterministic motion given by a stochastic equation with Gaussian 
and Poissonian white noises. The latter noise consists of a sequence of 5-function 
shaped pulses with random heights occurring at randomly distributed times. Such 
a noise appears in the physical world, for example, it describes the emission of 
electrons in diodes or the counting process of photons. As examples, we study 
two physical realizations of such a dynamics involving colloidal particles trapped 
on the unit circle. It turns out that analytical computation of the stationary density 
is possible only for the first realization, and not for the second. Hence, we resort 
to extensive numerical simulations to obtain the stationary density as well as the 
local velocity for the second realization. 

The first central section which contains novel results is Section 5 which is de- 
voted to the study of the behavior of a Markovian system under a perturbation. 
More precisely, Section 5.1 recalls the notion of response function to an arbitrary 
perturbation. Section 5.2 introduces a special family of perturbations, which we 
call Hamiltonian ones or generalized Doob /j-transforms. These include the usual 
perturbations considered in the physics literature. Section 5.3 proves in a very sim- 
ple way, thanks to the language of kinematics elements, that the recent GFDT J3] 
BEgElEglliH^ are obtained in this general Markovian con- 

text for the case of a Hamiltonian perturbation. We also numerically verify the 
GFDT in the context of the example of Section 4.3.2 involving stochastic dynam- 
ics with Gaussian and Poissonian white noise. Section 5.4 presents the GFDT 
which result from a more general class of perturbations, such as a time change 
0251 or a thermal perturbation pulse 01411781 . The second crucial section is Sec- 
tion 6. Here, we present global (non-perturbative) versions of these GFDT which 
involve a family of functionals called exponential martingales in the probability 
literature 1741 . Originally, a martingale referred to a class of betting strategies, but 
this notion has now become central to the modern probability theory and char- 
acterizes, ironically, a model of a fair game. A martingale is process whose ex- 
pectation in the future, given the knowledge accumulated up to now, is its present 
value {161 28, 33 771 1851 . In Section 6.1, we present a family of exponential mar- 
tingales, which are natural objects associated with the Hamiltonian perturbations 
because they are the ratio of the trajectory measures of the perturbed and the un- 
perturbed processes. Moreover, we prove in Section 6.1.3 that they also provide 
global versions of the GFDT. Finally, in Section 6.2, we revisit, in the light of the 
martingale theory, the usual FR for quite general Markov processes and underline 
the relation with the previously considered exponential martingales. In particu- 
lar, this rationalizes the typical martingale form (exp(— W)) = 1 of the Jarzynski 
equality. Section 7 presents our conclusions. The Appendices collect some simple 
but technical arguments. 

2 Elements of a Markov process 

As mentioned in the introduction, our study deals with nonequilibrium systems 
modeled by Markov processes. We begin by recollecting below some basic prop- 
erties of a Markov process I2J[7][T6 28 ,33 ,77 ,85 1. We consider a continuous time 
Markov process x, which takes values in a space S . The space S could, for exam- 
ple, be M d or a counting space. 
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2.1 Transition probability, stationary state and equilibrium 

The dynamics of the process is given by a family of transition functional P' s (x, dy) 
which satisfy the Chapmann-Kolmogorov rule: 

J P i : (x, dy)P' u (y, dz) =P' s (x,dz) V s<u<t, (2) 

where P"(x,dy) is the probability that the process has the value \y,y + dy] at time 
//. conditioned on the fact that it had the value x at time s. Here, and in the fol- 
lowing, the notation dy represents the Lebesgue measure or the counting mea- 
sure, depending on S . We will assume for simplicity that the transition functions 
and all other relevant functions admit a density with respect to this measure (i.e., 
P' s (x,dy) = Pl(x,y)dy). Moreover, we consider processes without death or explo- 
sion, i.e., with so-called honest transition probabilities, such that one has the nor- 
malization condition / dyP' s (x,y) = 1. This could be easily achieved in general, 
e.g., by enlarging the space to include a coffin state. It will be useful to think 
of the transition functions as linear operators P' which form an inhomogeneous 
semi-group, and which are defined by their action on a bounded function / in <§ 
in the following way: 



Pl[f](x) = j dyPl(x,y)f(y). 



(3) 



The family of transition functions of a Markov process which can be written down 
explicitly is very restrictive. Hence, it is more practical to define the generator L t 
of this inhomogeneous semi-group, under appropriate regularity conditions 11161 
1771 . by the following equation: 

P* = ex^ ( /' L u du) = £ / J] dstUx oL S2 o...o L s „ . (4) 

\J S J n J S<S\ <S2<...<S n <t J 

This equation is equivalent to the forward and backward Kolmogorov equation, 
given, respectively, by 

d t P> = F* o L t , and d s P^ = —L s o F* . (5) 

Here, the symbol o means composition of operators. Also, the initial condition is 
P/ = J^. For the transition function to be honest, the generator must obey L,[l] — 0, 
where 1 is the function which is equal to 1 on S . If the initial measure of the 
process is \i^{dx) = po(x)dx, we may define the averages of a functional of the 
process x as 

(F) = j' iio(dx)E to , x (F[x]), (6) 

where E, A stands for the expectation of the functional of the process x with 
the initial condition x to = x. Next, it will be useful to define a path measure 
M^ Q u i? ] [dx] = dM^ ^ fj [x] on the space of trajectories by the following equation: 

(F) = f F[x]M^ [s , t] [dx], (7) 



2 Presence of two time indices is a result of the non-homogeneous time character of the pro- 
cess. Such a process is sometimes called nonstationary in physics. For time-homogeneous pro- 
cess, we define P, _ s = P' s . 
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where F is a functional of the path from time s to time /. The instantaneous (or 
single time) probability density function (PDF) of the process is given by 

p t (x) = (8(x t -x)). (8) 

Its time evolution may be deduced from (fSJ. We obtain the following Fokker- 
Planck equation: 

d tPt =Lj\p t ], (9) 

where L] is the formal adjoint of L t with respect to the Lebesgue (or counting) 
measure. A stationary state (p r = p) then satisfies the equation 

L}[p}=0. (10) 

Further, one says that the process is in equilibrium, i.e., it satisfies the infinitesimal 
detailed balance relation if the following condition for the generator is satisfied^: 

poL,op- x =l]. (11) 

If the process is time-homogeneous, the above equation is equivalent to the usual 
detailed balance condition for the transition function: 

p(x)P,- t (x,y) = p(y)P,. s (y,x). (12) 

It will be useful to define two particular families of non-stationary states. First, one 
defines the so-called accompanying density % t which satisfies the instantaneous 
relation RTEgl 

i/W=0. (13) 

Next, we introduce the subclass of accompanying density, that we assume to be 
in local detailed balance, such that the generator verifies the instantaneous time- 
dependent version of the relation dl lb : 

%toL t 7T," 1 = h\. (14) 



2.2 Cotransition probability, current and velocity operator. 

The two-point density (<5 (x s —x)8 (x t —y)) of a Markov process is usually ex- 
pressed by conditioning with respect to the earlier time s, as 

(5 (x s -x) 8 (x,-y)) = p,(x)I*(x,y). (15) 

It can also be expressed by conditioning with respect to the later time t in terms 
of the so-called cotransition probability P*' (30 1 (sometimes called the backward 
transition probability H3 111701 Q) as 

(5 (x s -x) 5 (x, -y)) = P:'(x,y)p t (y). (16) 

3 Note that, with this definition, a non-homogeneous process can be i n equ ilibrium. We will 
see examples of diffusion process with this surprising property in Section l42l 

4 We will not employ this terminology because in our language, the backward process needs 
also a reversal of time 1111 . 



7 



This cotransition probability satisfies the Chapman-Kolmogorov equation ©, but 
the normalization condition becomes / dxP*'(x,y) = 1. The relation between the 
transition and the cotransition probability can then be expressed by the operator 
formula P*' = p s o P], o p t ~ 1 , which implies the forward equatiorQ 

d,P*< = P;> (p, oL, op- 1 -p- 1 (d tPt )) . (17) 

We will now introduce a family of operators L*, which we call cogenerators, by 
the following equation: 

l; = P - x oij o P , - p- 1 {$.(>,) j =pr 1 °4 o a - p- l h)[p t \j, (is) 

where J is the identity kernel, so that the cotransition probability now takes the 
operatorial form 




Then, the property / dxP*'(x,y) = 1 is equivalent, as before, to L*[l] = 0. For a 
stationary process dlOl). the cogenerator takes the form L* t = p~ l oL] op, which 
is the adjoint of L t with respect to the scalar product with weight p. It is also in- 
teresting to associate a current operator and a velocity operator (which depend 
on the initial density) with the density p, by the following equations: 

J, = p t oL, — L.J o p, and V t =L t - p, -1 o Lj o p, . (20) 

The Fokker-Planck equation (O can be expressed as 

d,p t + J t [l] = 0, or, equivalently, d t p, +p t V t [1] = 0. (21) 

The condition (1 1 Ob for the density p to be stationary can then be expressed as 

= 0, or, equivalently, V,[l] = 0. (22) 

Otherwise, the equilibrium condition dl lb becomes 

J t = 0, or, equivalently, V, = 0. (23) 

Finally, using ( 19118120b . we can express the cogenerator in terms of the velocity 
operator as 

l; =L t -v,+v t [i],y. (24) 

Then, by (124b . equilibrium implies L* t = L t . The converse of this statement is true 
because the condition L* = L t implies that for any function /, one has l] [ptf] — 
fL,] [p t ] = p t L t [/]. Then, on integrating by parts over all space, we get 
/ dx (-2f(x)L^ [p t ] (xfj = 0, which implies that h\ [p t ] = 0, and then p, = p. 

Finally, the condition L* = L t can be rewritten as the equilibrium condition. 

Figure [TJ illustrates these relations between stationarity, equilibrium and the 
condition of equality between the generator and the cogenerator. 



5 Here, the density p is regarded as a multiplication operator. In the following, depending on 
the context, we will consider p as a function or as an operator. 



Fig. 1 The figure illustrates the relation between stationarity, equilibrium and the condition 
L* = L,, as discussed in the text. 



3 Kinematics of a Markov process 

The notion of the velocity operator ( 1201) introduced in the last section is quite dif- 
ferent from the usual notion of velocity as the derivative of the position. Assume 
that we want to describe the "naive" kinematics of a general Markov process. 
The first difficulty is that the trajectories in general are non-differentiable (as in a 
diffusion process) or, worse, discontinuous (as in a jump process). This does not 
allow for a straightforward definition of a velocity. In the sixties, Nelson circum- 
vented this difficulty by introducing the notion of forward and backward stochas- 
tic derivatives in his seminal work concerning diffusion process with additive 
noise [69]. Here, we will reproduce the definition of Nelson for a general Markov 
process. In the following, we assume existence conditions on various quantities, 
with the expectation that these conditions have already been, or, can be established 
by rigorous mathematical studies. 

3.1 Stochastic derivatives, local velocity 

According to Nelson, a Markov process is said to be mean-forward differentiable 

lim,,^o( 2± P i <5(-Vr--i')) 

if the limit Wt « exists. In this case, this ratio defines the local 

(5{xt-x)) 

forward velocity for a process conditioned to be in x at time t: 




(25) 



Similarly, the local backward velocity is defined as 




(26) 



The local symmetric velocity and the local osmotic velocity are defined as 




(27) 
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In the same spirit, he defined the stochastic forward, backward and symmetric 
derivatives of function f t (x t ) of the process as 



/ /(r+;-..v f+/ ,)-/(M-,) \ 
lim A _> < tt o (x, ~x) ) 

dTW = (S(x,~x)) ' 



d , lim/nO< 5 '—8{xt-x)) (28) 

"2rW = (S(x,-x)) ' 

rfr W — 2 

Note that the set of forward, backward and symmetric local velocities are just 
special cases of derivatives of the function f t (x t ) = x t . With the definition of the 
forward transition probability and the cotransition probability given in d!5b and 
1 11 61 . we can rewrite the above equations as 

f i±L (,) = i im ^ i / dypj+h (A . y) {f{t + Ky) _ /(f >x)) 

A Taylor expansion of these transition probabilities using <(4j and ( [T9] l gives 

^±=d,+L t and ^=d t -L* (30) 
Also, the stochastic symmetric derivative becomes 

^ + ^- (31) 
The expression of the cogenerator from <f24b allows us to express the stochastic 
symmetric derivative in ( Bib in terms of the velocity operator d20l ) as 

V t -V f [l]^ 

5F = ^ + 2 ' (32) 



Then, for a steady state d22l) . 37 = ^ + y- 

We can then deduce that, in the equilibrium case, the stochastic symmetric 
derivative takes the form of the partial time derivative 4 = d t , which gives zero 
while acting on observables which do not depend explicitly on time. The local 
symmetric velocity , given in ( 127b . now reads 

v j {x) = m-m = vAA-mx\ (33) 

and then, for a steady state, vj (x) = . 

It is important to remark that equilibrium (V = 0) implies vanishing of the 
local symmetric velocity but the converse of this statement is not true. Figure [2] 
illustrates the relation between stationarity, equilibrium and vanishing of the local 
symmetric velocity. 

One of the authors of the present article proved in 1141 that a diffusion process 
in the Lagrangian frame of its mean local symmetric velocity takes an equilibrium 
form, and then the concept of equilibrium and nonequilibrium become closer than 
usually perceived. However, this property is no longer true for a general process 
due to the inequivalence between equilibrium and vanishing of the local symmet- 
ric velocity. 
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Fig. 2 The figure illustrates the relation between stationarity, equilibrium, and vanishing of the 
local symmetric velocity, as discussed in the text. 



3.2 Time derivative of two-point correlations 

Here we provide useful formulae for the time derivative of the two-time (s < t ) cor- 
relation of observables U and V in terms of the correlation of stochastic derivatives 
(forward or backward) of these observables. The two-point correlation can be ex- 
pressed in term of the forward transition probability and cotransition probability, 
<Q3), (O, as 



(U s (x s )V t (x t )} = J dxdyU s {x)p s {x)P t s {x,y)V t {y) = j dxdyU s (x)P? ' {x,y)p t (y)V t (y). 

(34) 

We then obtain the formula 



dt (U s (x s )V t {x t )) = (u s {x s )^-{x t )\ and d s (U s (x s )V t {x t )) = (i^-(x s )V t (x t ) 

(35) 

The proofs are direct consequence of the definition of transition and cotransition 
probabilities ( |4|19l l and of forward and backward stochastic derivatives, and are 
given in Appendix (TA1 . These relations provide motivation for a proof of general- 
izations of FDT by involving the stochastic derivatives, as discussed later in the 
paper. 



4 Examples of Markov processes 

We will now investigate the form of the velocity operator d20l ) and of the local 
symmetric velocity (133b for the three most popular examples of Markov processes, 
namely, the pure jump process, the diffusion process and a process generated by a 
stochastic equation with both Gaussian and Poissonian white noise. 
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4.1 Pure jump process 

Roughly speaking, a Markov process is called a pure jump process (or, a pure 
discontinuous process) if, after "arriving" into a state, the system stays there for 
an exponentially-distributed random time interval. It then jumps into another state 
chosen randomly, where it spends a random time, and so on. More precisely, x r is 
a pure jump process if, during an arbitrary time interval [t,t + dt], the probability 
that the process undergoes one unique change of state (respectively, more that one 
change of state) is proportional to dt (respectively, infinitesimal with respect to dt ) 
[33 ] . In a countable space, one can show that all Markov processes (with right con- 
tinuous trajectories) are of this type, a property which is not true in a general space. 
It is usual to introduce the intensity function A? (x) such that A, (x) dt + o(A, (x)di) is 
the probability that x, undergoes a random change in the time interval [t,t + dt] if 
the actual state is x t = x. If this change occurs, then x(t + dt) is distributed with the 
transition matrix T t {x,dy). Such a process naturally generalizes a Markov chain to 
continuous time. 

We introduce the transition rate of the jump process, which gives the rate at 
time / for the transition x — > y, through 

W t (x,dy)=^(x)T,(x,dy). (36) 

One can prove that, with regularity condition 13311771, such a process possesses 
the generator 

L t (x,y)=W,(x,y)-S(x-y) \J dzW t (x,zf) . (37) 

The current and the velocity operator, given in d20l , take the form of the kernel 

/, (x, y) = p, (x)W, (x, y) - W, (y, x)p t (y) and V, (x, y) = W t (x,y) - p- 1 (x)W t (y,x)p, (y) . 

(38) 

Otherwise, the local symmetric velocity (133b takes the form 

v t (x)= 1 -Jv t (x,y)(y~x)dy. (39) 

4.2 Diffusions processes 

Here we are interested in a Markov process which has continuous trajectories. 
More concretely, the main objects of our study are the non-autonomous stochastic 
processes x t in S% d (or, more generally, on a c/-dimensional manifold), described 
by the differential equation 

x = u,(x) + T]t(x), (40) 

where x = 4*, u t {x) is a time-dependent deterministic vector field (a drift), and 
r\ t (x) is a Gaussian random vector field with mean zero and covariance 

<l/(*)l/Cy)> = 8(t-s)Dy(x,y). (41) 
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Due to the white-noise nature of the temporal dependence of T] t (typical 77, are 
distributional in time), d40l ) is a stochastic differential equation (SDE). We shall 
consider it with the Stratonovich convention 11851 . keeping for the Stratonovich 
SDE's the notation of the ordinary differential equations (ODE's). The explicit 
form of generator L t which acts on a function / is 



Ltlf] =%dif- 



where 



(42) 



d'/(x) 



D l t J (x,x) and u! t (x) = u\(x) - jd yj D 1 / (x,y)\ y= 



(43) 



Here, S| (x) is called the modified drift. A particular form of ( 1401) which is very 
popular in physics is the so-called overdamped Langevin form (with the Einstein 
relation): 

1 



x< = -r t ,] {x)djH t {x)+G\{x) + -d vJ D l t ] {x,y) 



+ 7]/(jc) and^'(x) = -j; ,7 (x), 

(44) 

where H,(x) is the Hamiltonian of the system (the time index corresponds to 
an explicit time dependence), J7(x)is a family of non-negative matrices, G t (x) 
is an external force (or a shear), j5 the reciprocal of the bath temperature and 



d y jD' t J (x,y) 



is an additional spurious term which comes from the x depen- 



dence of the noise. This additional term is chosen in such a way that the accom- 
panying density dT3l is the Gibbs density ex v(~P H >\ m the case where the external 
force is zero (G = 0). Then, in the case of stationary Hamiltonian and tempera- 
ture (i.e., H t = H,Pi = j3) and without the external force (i.e, G = 0), the Gibbs 
density gSlzgS j s an equilibrium density, see (fTTT) . Note that this last case, in 
the situation where the matrix F t depends explicitly on time, is an example of a 
non-homogeneous process in equilibrium in the state exp(— /3//). The presence 

was extensively studied in the literature of 

x=y 

and we can see that it vanishes in the case of 
linear Brownian motion where r t (x) = T t . The overdamped property comes from 
neglect of the Hamiltonian forced In addition to the operator current, the oper- 
ator velocity d20l and the local symmetric velocity d33l) , it is usual for this type 
of process to introduce the hydrodynamic probability current j t , respectively, the 
hydrodynamic velocity v t , associated with the PDF p,, ©, through 



of the spurious term d y j D 1 / (x,y) 
non-linear Brownian motion 1531 



jt = u t pt 



|(VP,) 



and v t = u t 



|(Vlnp,) 



(45) 



such that the Fokker-Planck equation (O takes the form of the continuity equation, 
respectively, the hydrodynamical advection equation, 



dtpt + Vift = and d t p, + V; (p,v i t ) = 0. 



(46) 



6 The Fluctua tion-Dissipation Theorem with such Hamiltonian force has been studied in 
details in 1131141 . 
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A direct calculation, given in Appendix (O, shows that the explicit form of the 
cogenerator d 1 8b for a diffusion process is 

mf]=m/}-2v t .vf, (47) 

and we can deduce the form of the operator velocity, j20b , as 

V t [f] = (L,-p- X oLiop t yf} 

= (L t -L:-p;\d,.p t ),y)[f]=2v t .Vf+(p- l V i (p t 7 t ))f. (48) 

Moreover, for a diffusion process, ( 1471 ) allows us to obtain the following hydro- 
dynamical form for the stochastic symmetric derivative and the local symmetric 
velocity. 

j t = d, + v t . V and v, (x) = v, (x) . (49) 

It then follows that the local symmetric velocity is identical to the hydrodynamic 
velocity, and moreover, with d48b , that the equilibrium condition (V t = 0) is equiv- 
alent to the condition of vanishing of the hydrodynamic velocity v t or the local 
symmetric velocity in <£0- Also, the form of the drift of an equilibrium diffusion 
is then 

u, = |(Vlnp). (50) 

The link between stationarity, equilibrium and vanishing of local symmetric ve- 
locity for a diffusion process is depicted in Fig. 3. 




Fig. 3 The set of processes inside the domain marked in red are such that the local symmetric 
velocity vanish, but it is also the set of equilibrium jump processes and the set of processes with 
vanishing hydrodynamic velocity. 



7 In 1221 . a result in a similar spirit was shown for the characterization of diffusion processes 
with additive covariance d' t J (x) = d8'' which possesses a (possibly time-dependent) gradient 
drift. The characterization can be written in terms of a second-order stochastic derivative as 

~dP~ ~ dP~ ■ 
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4.3 Stochastic equation with Gaussian and Poissonian white noise 

We now consider a Markov process in continuous space (e.g., & d ) which includes 
the processes in the last two sections in the sense that both diffusion and jump 
can occur. Such processes are very popular in finance II17II68II . They are much less 
popular in physics, where, after its first study in the beginning of eighties ll40ll88l . 
they were used, for example, to study mechanism of noise-induced transitions |79 ] 
or noise-driven transport II21II63I . We consider processes that are right continuous 
with a left limit (i.e., "cadlag" processes), and we define x t - = lim s px s and the 
jump as 

Ax t = x t —x t - . (51) 

We want to consider a process which follows the evolution of a diffusion process 
(140b for most of the time, excepting that it jumps occasionally, the occurrence of 
the jump being given by a non-autonomous Poisson process. More precisely, we 
will construct such processes by adding a state-dependent Poisson noise 1751 to 
the stochastic differential equation ( 140b . as 

x, = a, (x t ) + 7] t (x, ) + w t {x t - ) , (52) 

where, as before, r\ t (x) is a Gaussian random vector field (with Stratonovich con- 
vention l85l ) which has mean zero and covariance (HTT) . On the other hand, w,(x) 
is a state-dependent Poisson noise (that depends on the state x t ), and is given by 

N, 

w t (x) = 1 £y i (x)8(t-T i ). (53) 
/=i 

The time T, at which the instantaneous jump occurs are the arrival times of a non- 
homogeneous and non-autonomous Poisson process TV, with intensity A, (x) . The 
jump magnitude y, are mutually-independent random variables, independent of 
the Poisson process, and are described by the probability function b tx (y). This 
function gives the probability for a jump of magnitude y while starting from x 
at time t. Physically, addition of the Poisson noise mimics large instantaneous 
inflows or outflows ("big impact") at the microscopic level. We remark that this 
noise contains almost surely a finite number of jumps in every interval (A,(x) is 
finite). It is possible to consider a more general noise, the so-called Levy noise, 
where this condition is relaxec0. The mathematical theory of general stochastic 
differential equation with a Levy noise and the theory of stochastic integration 
with respect to a (possibly discontinuous) more general (semi- martingale) noise 
are well established EJO. In the present case, we will just use from this theory the 

8 The process x, then describes a fairly large class of Markov processes (of Feller-type) 
which are govern ed by Levy-Ito generators which acts on a function / as the integro-differential 
operators 1461861 

L, [/](*) =V,{x)d xi f+\d xJ km/l + L r , (/(x + .y)-/(x)- ( - V ; V ^ )( 2 X) ) v„(rfv), 
L J J®i-{0} \ l + |yj 2 J 

(54) 

with the so-called Levy jump measure v, x (dy) which can be infinite but is such that, for all x 

i- 

and t, the condition J^</_{ } Vtjc(dy) < °° is verified. 
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form of the Markov generator which, for the process ( 1521) , is an integro-differential 
operator, given by 

L t =L?+L J t . (55) 

Here, the diffusive part Lf is given by (1421) and the jump part L J t is given by (137b . 
with 

W t (x,y) = X t (x)b tjX (y-x). (56) 
The class of process ( 1521 ) possesses some famous particular cases. 

- The piecewise deterministic process 1231 is the case where there is no Gaussian 
noise (v\ t (x) = 0). Then x t follows a deterministic trajectory interrupted by 
jumps of random timing and amplitudes. 

- The interlacing Levy Processes J2] is the case where the drift is constant 
and homogeneous (u t (x t ) = w), the Gaussian noise is additive and stationary 
(d' t J (x) = d' J ), and the Poisson white noise is state-independent and station- 
ary (Xt{xt) = X and b tJi {y) = b(y)). This process belongs to the class of Levy 
process 0, with independent and homogeneous increments. 

We will now investigate the form of the kinematics elements: the velocity op- 
erator, ( 120b . and the local symmetric velocity, ( [33t . Similar to (155b . these two 
objects can be split into a diffusive part and a jump part such that 

V, = V t D + V t J and v, = v? + v J t . (57) 

On using J 178b . we can express the diffusive part V t D as ( 148b 



= p-'Vt U ( % - %- (V>p f ) J J +2 f 5j- %- (V>p r ) ) V,-. (58) 



|(V / lnp,)jj+2^-^ 

The jump part V/ is given by (1381 ) with (l56l l. Similarly, the diffusive part of the 
local symmetric velocity reads 

v?(x)=«j(*)-^(V;ln Pj (*)), (59) 
while the jump part of the local symmetric velocity reads 

J( v fdyW,(x,y)(y-x) - fi~ 1 W J dyp, (y)W, (y, x) (y - x) 
v, (x) = . (60) 

Finally, the stochastic symmetric derivative d32b takes the form 

d ^.(tf d 1 / \ W t -pr l oW?op t -X,,y + p - l W?{ P ,],y 

~dt~ [ Ut ~ T (V ^' lnP ' ) ) V/ + 2 • 

(61) 

Here, we are in the general case where the link between equilibrium (V = 0) and 
local symmetric velocity is shown in Fig. [2] However, we remark that the condition 

u t = |(Vlnp) and p(x)W t (x,y) = p(y)W t (y,x) (62) 
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is a sufficient and a necessary condition to be in equilibrium ( V = 0) 0. 

A particular form of such jump diffusion process ( 1521 ). that we call jump 
Langevin equation, is obtained from the Langevin equation ( 144b by adding a Pois- 
son noise w t , as 

x 1 = -r t iJ {x)d J H t (x)+Gi(x) + ldjDl i (x,y) + ij/(jc) + wj(x), (63) 

Z ' x=y 

with df (x) = ^r r ' J (x) such that the transition rate, d56l l. takes the particular form 
(Kangaroo process JSJ) 

W,(x,y) = rexp (-£ (H,(y) -H,(x))j , (64) 



where r is real. The accompanying density dl3l ). in the case without external force 

z, 



(G, = 0), is the Gibbs density e M M) _ jf in addition, we have a stationary 



Hamiltonian {H, = H), such processes verify the sufficient equilibrium condition 

(162b in this Gibbs density p (x) = exp ^ 
amples of jump diffusion process (152b 



in this Gibbs density p (x) = exp ( P H (-^ w e w ju now consider physical ex- 



4.3.1 Example 1 : Interlacing Levy process on the unit circle 

The most elementary example of an interlacing Levy process which describes a 
nonequilibrium system is a particle on a unit circle subject to a constant force G, 
as 

e t =G + r} t +w t , (65) 

with an additive and stationary Gaussian white noise (d' t J (d) = d) and a state- 
independent and stationary Poisson white noise (Af(0) = A and b, g (0') = b{9')). 
Moreover, the jump amplitude is a periodic function, b(0) = b(6 + 2n). The 
Fokker-Planck equation (0 becomes, with (155b. 

d r 2jl 
d tPt (e) = -Gd e p,(e) + -3^,(6) -Xp,(6) + X dd'b(d-d') Pt (d'). (66) 
2 Jo 

Then, the process possesses an invariant probability distribution with the constant 
density p(9) — j=. This is true also in the absence of Poisson noise (A = 0) or 
Gaussian noise (d — 0) . For the stationary process, where we take the invariant 
density as initial density, the velocity operator ( 157158b takes the form 

Vlf\(e)=2Gd e f+Xj d6'(b{6'-6)-b(6-6'))f(6'). (67) 

In the absence of external force (i.e., G = 0), we see that the Poisson noise trans- 
forms an equilibrium state to a nonequilibrium steady state if b is not an even 
function. Finally, the local symmetric velocity takes the form ( 157159160b 

A r 27t 

v(9) = G+- de'6'(b(d'-6)-b(6-6 / )). (68) 

z JO 

9 That the condition is necessary follows from the fact we can split up the kernel V, into a 
regular and a distributional part, and both should vanish to ensure that V, = 0. 
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For example, if we choose the probability of the jump distribution as b{9) — 
1+ S ' tnen ^ e l° ca l symmetric velocity in the steady state takes the form 
v(0) — G+j^ Jq 71 dd' sin (0' - 0) 6' = G - X cos(0). So, despite the fact that the 
Poisson noise does not change the invariant density, it changes the local symmet- 
ric velocity which is no longer constant around the circle. For example, if G < A, 
it includes regions of the circle where the local transport is in the reverse sense to 
the external force. 



4.3.2 Example 2: Jump Langevin equation on the unit circle 

We consider a particular case of ( 1631 ). namely, 

d l = -d e H + G + r] l + w t , (69) 

which describes the angular position of an overdamped particle on a circle. The 
Hamiltonian H is 27T-periodic, the force G is a constant, the Gaussian white noise 
r\ t has the covariance (T\ s r\ t ) = jS(t —s), and the transition rates of the state- 
dependent Poisson white noise are given by (164b . Such systems without the Pois- 
son noise (r = 0) have been realized with a colloidal particle kept by an optical 
tweezer on a nearly circular orbit 081 . In these experiments, H(9) = asiad. In 
this case, the invariant density takes the form lfT2ll 

p(0) =Z- 1 exp(-j3{//(e)-G0}) 

e in 
(| exp(j5{H{&)-GT}})dT} + exp(2nj5G) j exp(j3{//(#) - Gtf})rftf) , 







(70) 



where Z is the normalization factor. The corresponding local symmetric velocity 
(also the hydrodynamic velocity in the present context) takes the form 

■W-H-r' g^ . CD 

However, with the Poisson noise (r 7^ 0), it is not possible to obtain analyti- 
cally the form of the stationary state, except in the equilibrium case (i.e., without 
external force, G = 0), where the equilibrium density is 

p(0)=Z- 1 exp(-j3//(0)), (72) 

and the local symmetric velocity is zero. We realize a numerical simulation of the 
system d69l with a = 0.87 s~ l and j3 = 0.%s (these values for a and j3 are close to 
those used in the experiment [38]), but with a non-vanishing Poisson noise (r 7^ 0). 
We can imagine for example that it is once again the laser beam which produces 
the two noise. We first verify numerically that we find the equilibrium density ( 1721 ) 
for three values of r = 0.001,0.01, and 0.1 in the case G = 0. The results of the 
numerical simulation are shown in Fig. |4] which confirm the independence of the 
equilibrium density on the Poisson noise. 



18 




0.05 1 1 1 1 1 1 - 

1 2 3 4 5 6 





Fig. 4 The points in the figure show the equilibrium density p(0), obtained from numerical 
simulations of the dynamics ([69} with H = a sin 9, and with G = 0, a = 0.87s~', /3 = 0.8s, and 
for three values of r = 0.001,0.01, and 0.1. It can be seen that the results do not depend on the 
value of r. In the figure, the results of numerical simulations have also been compared with the 
analytical result given in f72t with H = a sin 8, and is represented in the figure by the continuous 
fine. 



(a) (b) 




Fig. 5 (a) The points represent the stationary density p (6), obtained from numerical simulation 
of the dynamics ((69) with H = a sin 0, and with G = 0.85s~ 1 , a = 0.87.s~' , j8 = 0.8s, but without 
the Poisson noise (r = 0). As expected, the points may be seen to lie on the continuous line 
representing the exact result in <70t . (b) Here, we show the stationary density p(0), obtained 
from numerical simulations of the dynamics d69l with G = 0.85.s~', a = 0.87 s~ l , /3 = 0.8s, and 
for r = 0.0001,0.001, and 0.1. It is easily seen that p(6) depends on the value of r, thereby 
hinting at the important role played by the Poisson noise. 



Next, we investigate numerically the case where the external force takes the 
value of the experiments 081 (G = 0.85s -1 ) for three different values of r (which 
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Fig. 6 (a) The figure shows the local symmetric velocity v(6) for the dynamics i69i with H = 
osine, and with G = 0.85.S" 1 , a = 0.87.?-', j3 = 0.8s, and for r = (no Poisson noise), 0.0001, 
and 0.001. The points are obtained from numerical simulations of the dynamics and use of the 
formula J73t , The exact result for the case r = is given by fTO , It is easily seen that v(6) 
depends on the value of r, i.e., on the details of the Poisson noise in the dynamics. 



characterizes the role of the Poisson noise), namely, r = 0.0001,0.001, and 0.1. 
The corresponding forms of the stationary state distribution are shown in Fig. 
|3b). From the figure, it is evident that in the presence of the external force, the 
form of the non-equilibrium stationary state depends on r, thereby underlying the 
importance of the Poisson noise. This is to be contrasted with the result for the case 
depicted in Fig. |4] i.e., with G = 0, when the form of the equilibrium stationary 
state is independent of r. Corresponding to the non-equilibrium stationary state 
for G^0, the local symmetric velocity ( 1571591601 is given by 



v(0) = -acos(d) + G-pd e (lnp(fj)) 

rexp(f sin(0)) ( ft* ( fia . 

J ad exp I — — sin(0 ) J 8 



rp- 1 (0)exp(-^sin(0)) ( . , .. 



pa 



(73) 



In Fig. [6] we show the local symmetric velocity v(0) for the dynamics 
with G = 0.85s' l ,a = O.Sls' 1 , j8 = 0.8s, and for r = (no Poisson noise), 0.0001, 
and 0.001. It is clear from the figure that the quantity v(6) depends on the details 
of the Poisson noise in the dynamics. 
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In Section 15.3.11 we will use the dynamics d69b as a model system to verify 
the GFDT by extensive numerical simulations. 

5 Perturbation of a Markov process: the Fluctuation-Dissipation Theorem 

Suppose that our dynamics evolves for f < with a given Markovian dynamics of 
generator L t and then suddenly, at time t = 0, we perturb the dynamics such that 
the new Markov generator L' t becomes 

L' t =L t +k t N t , (74) 

with k t a real function, sometimes called the response field, and N t an operator. 
We will assume that the perturbed process still has the property to have honest 
transition probability (i.e., N,[l] = 0). The FDT concerns the relation between 
correlation functions, d34l) , in the unperturbed state and response functions in the 
case of a small perturbation (i.e., k, infinitesimal). 

5.1 Response function 

The linear response theory allows to express the variation of the average of an 
observable under the perturbation as 

= (( p - l N^[p i ])( Xs )ArM) 1 (75) 

where ()' denotes expectation for the process with the generator L' t . The proof 
of this relation is given in Appendix © for the convenience of the reader. Note 
however that this result is known for a long time in the physics literature lfT1 l4T1l5T1 
1751 and now has a mathematically rigorous formulation (Definition 2.5 in l25l ). 
This relation, besides being the basis for the FDT, allows to prove the Green- 
Kubo relation 11521 in the case of homogeneous perturbation (k t = £) of a stationary 
dynamics. Note that other higher order relations may be derived in the context of 
the non-linear response theory II59L 

5.2 Hamiltonian perturbation class or generalized Doob /z-transform 

We will see that the form of the perturbation is the central point of the FDT, and 
it does not make sense to talk of FDT without giving its form. We want to begin 
by studying a class of (non-infinitesimal) perturbation of the Markov process such 
that the transformation of the generator can be expressed in terms of a family of 
non-homogeneous positive function h t , as 

L t = h- 1 oLtoh, - h- l L r [h t ] = l} t . (76) 

In the case where = d,h, +L, [h t ] = (h t (x) is the so-called space time har- 
monic function), such a transformation is classical in the probability literature 
and is called the Doob /i-transform (or gauge transformation in physics literature). 



8{Mx,)) 
8k s 
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This was first introduced by Doob ( ll28l ; see also chapter 11 of ifTBll ). and plays 
an important role in the potential theory. We remark that if h t (x) is space-time 
harmonic, then h t (x t ) is a martingale, i.e., 

h t (x)=E KK (h T (x T )) VT>t. (77) 

By introducing the symmetric bilinear operator F (the so-called "carre du champs" 
11771 . which can be roughly translated into English as "square of the field", such 
that r t (f,g) =L t [fg] — fL, [g] — L t [f] g, the perturbed generator can be expressed 
in the form Lf = L t +h^ 1 r(h t ,). A remarkable property of this type of pertur- 
bation appears if we restrict to a subclass of unperturbed processes which are in 
so-called local detailed balance J 14b with the Gibbs density % t = exp(— j3//,). We 
then have the relation 

hfitt oL 1 } o (hjnt) 1 = h,7i, oL,o (n,y l h~ x - hJ x L t {h t ) 

= h, olloli" 1 - h- l L,(h t ) = ' , (78) 

which implies that, for the perturbed process, the density, given by 

7r/ ! = 7t,hf = exp(-pH t + 21n/z f ), (79) 

is also in local detailed balance. This property of conservation of instantaneous 
infinitesimal detailed balance under the perturbation of the Hamiltonian H — > 
H — j| Inh, is the first justification for the name "Hamiltonian perturbation" that 
we chose for this type of perturbation. However, we stress that this perturbation, 
although called here "Hamiltonian perturbation", is applicable to general Markov 
processes which do not have an underlying Hamiltonian which generates the dy- 
namics. Moreover, for a general diffusion process, we can easily calculate (see 
Appendix (O) the operator "carre du champs" 

r t (f,g) = di j (v i f)(Vjg). (80) 

Then the perturbed generator (|76| > is 

l}=L,+4 i VjQn\h t \)V i , (81) 

so that there is just a change of the drift term, u\ — > u\ +d 1 / V/(ln/j,). In the subcase 
of an overdamped Langevin process (144b . the perturbed process ( 176b becomes 

2 \ d yj D'/(x,y) 



x' = -r t ,J (x)dj \H,(x) ~p^h t J +G' t (x) + j — + l/M • < 82 ) 

So we see that the perturbation in ( 176b is once again equivalent to change of the 
Hamiltonian, H —>H— j In h, . Now we want to show that the type of perturbation 
in (176b includes the perturbation usually considered in the articles on FDT that 
exist in the literature. 
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- For pure jump process, it is usual to ask precisely the property of conservation 
of this local detailed balance for the Gibbs density n t = exp(— /3//,) under the 
perturbation of the Hamiltonian H — > H — k,O t . We see from d79l ) that this 
perturbation of the Hamiltonian is of the type in ( 1761 ). with the choice 

ht=ex V (^k t O t y (83) 

This implies the following transformation for the transition rates. 

W t h (x, y) = exp (- ILkt O, (xfj W, (x, y) exp {^k t O t (y)\ . (84) 

This is the perturbation considered recently in J3] and earlier in l27l for finding 
the GFDT in this pure jump process set-up. 

- For overdamped Langevin process, it is usual 041115 Ill66ll78ll to do a perturba- 
tion of the Hamiltonian, H -t H - k,O t , in (04]). With ([82]!, we see that it is of 
the type in ( 176b with once again (183b valid. 

- Finally, we remark that for a jump diffusion process of type ( 1521) . this pertur- 
bation consists of a change of the drift according to u\ — > u\ +d'/'Vj(lnh t ) and 
simultaneously, a perturbation of the jump process by replacing the transition 
rates (|56l) by 

W t h (x 1 y)=h; 1 (x)W l (x,y)h t (y). 

For the jump Langevin process d63l ). with the transition rates d64b for the Pois- 
son noise, we can prove easily that the choice ( 1831 ) in ( 1761 ) is equivalent to the 
perturbation of the Hamiltonian according to H —tH — k, O t . 



5.3 Fluctuation-Dissipation Theorem for Hamiltonian perturbation 
In the case of an infinitesimal h t function, 

h t {x) = \+k t B t {x) + 0{k 2 ), (85) 
we find that the Hamiltonian perturbation d76l) has the infinitesimal form d74l with 

N t =L t oB t -B t oL t -L t [B t \J r . (86) 

The central point of the proof that follows is the fact that the observable p _1 A^ [p], 
which appears on the right hand side of ( 175b . can be expressed in terms of the 
stochastic derivative (associated with the unperturbed process) of the observable 
Bf 

pr l N?[p t ] =B,p- x L\p t ]~p- 1 ol)op t [B t ] ~L,[B,} 

=-{i*+*)m = (±-±)m, (87) 
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where the third equality comes from d30l . We can rewrite this observable by 
adding a term proportional to — — B (which is exactly equal to zero), 
and then, for all a, we get 

(88) 



r 1 N?[ Pt ] = (l-a)^B t -(l + a)^B t + 2ajB t . 



Now, by using the response relation, d75T l and the time derivative of a correlation 
function, d35l l. we find the family, indexed by a , of equivalent GFDT. 

8{A t {x t ))' 



k=0 



Sk s 

(l-a)d s (B s {x s )A t (x t ))-(l + a)/ ^ (x s )A t (x t )\+2al^- (x s )A t (x t ] 



(89) 



Two particular cases of a exist in the literature: 
- a = : First GFDT 



S(A t (x t ))' 



5k, 



d s (B s (x s )A t (x t )) 



k-0 



ds 



(x s )A t (x,] 



(90) 



= d, (B s (x s )A t (x t )) - ((d s B s ) (x s )A t (x t )) - ((LB), (x s )A t (x t )) . 

(91) 



damped Langevin process, with ( 183b , we find B, = jO t and then 



In the usual case of Hamiltonian perturbation of a jump process or an over- 



(92) 



2 8(A t (x t )Y 



k=0 



( ^^{x s )A t {x t ) 



= d s (O s (x s )A r (x,)) - ((d s O s ) (x s )A t (x,)) - ((LO) s (x s )A t (x,)) , 

(93) 

which was first written down in [20] for diffusion process with additive noise 
and recently in |3 ,4 58 62 81) for jump process and overdamped Langevin pro- 
cess. The equilibrium limit fl} is a bit obscure; it may be seen by noting that one 

has {{LO) (x s )A(x t )) = (A(x s ) (LO) (x t )) = d t (A(x s )0(x t )). However, there exists 
physical interpretation of the new term {{LB) S (x s )A t (x t )) as the "frenetic term" 

Effl. 

- a = -\ : Second GFDT 



1 5 (A, (*,)>' 
2 



8k, 



^ = d, (B s (x s )A, W> - ( ^ (*) ) > C 94 ) 
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which has the advantage that the effect of the nonequilibrium character of the 
unperturbed state is just in the second term on the right hand side. For a diffusion 
process, this GFDT can be written 112II13ITT41 , with (@9]>, as 

1 S(A t (x t ))' 



2 5k< 



= d s (B s (x s )A t (x t )) - ((d s B s ) (x s )A t (x t )) - ((V S C .VB S ) (x s )A t {x t )) . 

k=0 

(95) 

This GFDT was experimentally checked in l38l . In the usual case of Hamiltonian 
perturbation of a pure jump process or a overdamped Langevin process, with ( 183b . 
we find 



1 5 (A, (*,))' 



d s (O s {x s )A t {x t ))-{^{x 



j3 8k, 

5.3.1 Example of jump Langevin equation \4.3.2\ . 

Here, we want to numerically verify the GFDT ( 1941 ) for a Markov process which 
mixes jump and diffusion. We consider the stochastic dynamics ( 1691 ) with H = 
asm and the same values for the parameters as those considered in ( 14.3.21) ; a = 
0.87.Y -1 , G = 0.85i _1 , j3 = 0.8i, and r = 0.001. The process is supposed to be at 
time / < in the stationary state with p(9) given in Fig. [3b). Then, suddenly, at 
t = 0, we consider a static perturbation of the Hamiltonian according to 

H' =H-ksmd = (a-k)smd. (97) 

We saw in the last section that this perturbation is of the form (1761). with 

/!(0)=exp^|fcsin0^ . (98) 

We checked numerically the time integrated version of the FDT d96l ) around 
steady state for A = B = sin d. 

(sin 8,y\ k=0 = (sin 2 0,)- (sin O sin 9 t ) - £ ds (C(9 S ) sind,) . (99) 
The form of the observable C(0) = ^^-(0) is found with the help of (|6B as 



-acos(0)+G-^(d e lnp) 



(/t/0'W(0,0')(sin(0')-sin(0))) 

f)')W(f)' Q\\ 

(100) 



2 

p" x (0) (/ dd' (sin(e') - sin(0))p(0')W(0', 0)) 
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0.5 
0.4 
0.3 
0.2 
0.1 



(sin 2 6> t ) - (sin0 o sin0 t ) 



(sm 2 6 t ) - {sin<9 n sin<2 f ) - Jgds(C(0 s ) sin 9 t ) 



\ 



I 



f[ds(c(e s ) S ine ti 
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Time steps for numerical simulation 
(Time interval ~ 0.01) 

Fig. 7 Based on our results from numerical simulations of the dynamics l |69t with H = asm©, 
the figure shows the different terms in the integrated version of the GFDT {99}. Here, a = 
Cl.87.s~ 1 , G = Cl.85.s~ 1 , /3 = 0.8.s, and the parameter r = 0.001. One observes a satisfactory agree- 



ment between the left hand side jj- Jj{sin0 ( )'|jfc = Q and the right side (sin 2 6 t ) 
Jo ds {C(6 S ) sin 6,} of the GFDT l(99]i, which therefore verifies the theorem. 



(sin 6 sin©,) 



with W(9,9') given by J64b 

W(6, d') = rexp (sin(0') - sin(0)) J . (101) 

Figure [7] shows results from our numerical simulations for the various terms 
in the integrated version of the GFDT ( 1991 ). In the figure, one can observe a sat- 
isfactory agreement between the left hand side and the right side of ( 1991 ), thereby 
verifying the GFDT. 



5.4 Fluctuation-Dissipation Theorem for a more general class of perturbation 

We will now consider a larger class of perturbation than J76I) such the perturbation 
can be expressed in terms of two family of non-homogeneous functions and h' t , 
as 

L',=h- 1 oL,oh' t ~h- x oL,[h' t ], (102) 

which specializes to the Hamiltonian perturbation (T76b when h = h' . We will see 
in the following subsections two physical perturbations, the time change and the 
thermal perturbation, which belong to this class. In the case of infinitesimal per- 
turbation, 

h, = 1 +k,B, + 0{h 2 ) and h' t = 1 +k,B' t + 0(h 2 ), (103) 
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we find that this perturbation has the form ( T74t with 

N, = —B, oL, +Lf oB' t —Lt[B' t ]. 



(104) 



For a pure discontinuous process, the perturbation (1102b implies for the transition 
rates, W( = h^ 1 oW t oh' t , and was considered in 127] and more recently in l65ll 
by taking h t (x) = exp(/j. /3k,0(x)) and h' t (x) = exp(y/3&,(3(x)), where 0(x) is an 
observable, and fj. and / two real numbers. As in (187b. we show that the observable 
Pt~ l ^t \Pt]i which appears on the right hand side of ( 175b . can be expressed in terms 
of the stochastic derivative of B, and B\ as 

p- l N + [p] = -p" 1 oL + op[B] +B'p- l L*[p}-L[B'} 

= -L* [B] -Bp- x L ] [p] +B'p- l L^[p}-L[B'} 
J ( dt +p-W\p]){-B + B>) + d -£- d -±f 
[or, ( dt +p-W\p])(-B+B>) + t(^-2f. 
We obtain then the generalization of the first GFDT d9Th 

s(Mx,)y 

8^s k=o 

I d B' 

= d s (B s (x s )A t (x,)) - ( -±-*-(x s )A t (x t ) 

+ ({{d s + p7 l L] [p s ] ) {B' s -B s )) (x s )At (* ) 
and the second GFDT J94l 

s(Mx t )}' 

k=0 



(105) 



8k, 



I dB' 

: d s {(B' s +B s ) (x s )Mx t ))-2(-^(x s )A t (x t ] 
<((^ + p7 1 L|[ P J) (B>-B s )) (xM*)). 



(106) 



We see that in the Hamiltonian perturbation class (i.e., B = B'), we recover the 
GFDT (I9TT941 . 

5.4.1 Around Steady State 

We will now restrict to the case where the observable does not have explicit time 
dependence (i.e., A t =A,B,= B,B' t = B'), and the unperturbed state is a steady 
state. Then the first GFDT f [T05T> becomes 



8 <£(*))' 



8k, 



= d s {B{x s )A{x t )) 



k=Q 



and the second dl06l) becomes 
8(A(x t ))' 



8k, 



d+B' 
ds 



,)A(x t ) 



= d s ( (B +B') (x s )A(xt)) - 2 ^ — (x s )A(x t ) 



(107) 



(108) 
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In the case where the steady state is of equilibrium-type (i.e. 4- = d s ), this last 
relation J 108b simplifies to the form 



S(A( Xl ))' 



8k, 



= d s ((B+B')(x s )A(x t )). (109) 

k=0 



5.4.2 Time change for a homogeneous Markov process A25V 

An example of perturbation which belongs to the generalized class J 102b but not to 
the Hamiltonian perturbation class ( 1761 ) is when we consider the change of clock 
as follows. 

t f (s) = frfuexp (/„(*„)), (110) 
Jo 

where /„ is an observable. It is proved in l25l (proposition 3.1) that the process 
x\ = x t // s \ is still Markov with a generator L t = exp(— f t )L. In the case of infinites- 
imal perturbation f u (x) = k u B{x), L t = L — k,BL, which is of the form ( 1104b with 
B' = so that the FDT ( Il031ll06l) takes the form 



8(A(x t )Y 



8k, 



= d s (B(x s )A(x,)) - { (p^L* \p s ]B) {x s )A{x t )) . (Ill) 

k=0 



In the case of an unperturbed system in the steady state, ( 11071108b become the 
usual FDT. 

8(A(x t ))' 



8L 



= d s (B(x s )A{x t )), (112) 

k=0 



which is a result of 125] . We want to emphasize that, for this type of perturbation, 
we obtain the usual FDT (without correction) for an unperturbed state which is a 
general nonequilibrium steady state. 

5.4.3 Thermal Perturbation Pulse : Change of temperature for equilibrium 
overdamped Langevin process 

A famous example in physics for a perturbation which is not of Hamiltonian type 
is thermal perturbation. Let us consider a system whose dynamics is governed by 
(144b . with G = and homogeneous Hamiltonian, and the perturbed system which 
results from the change of the bath temperature f5 t ~ l = (1 +k t )j3~ 1 . We can easily 
prove that 

N=^V i0 r ij oV h (113) 

which is of the form of the general infinitesimal perturbation (1104b with B' = 4p 

andB = ^-1. This can be easily seen by using the formula d80h for the "carre 
du champs": 

2r'J BH 
LoB' -L[B'}=B'L + r{B',.)=B'L+——{y i B')V j = 1-—L-L + N. (114) 

P ^ 
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S{A,(x t ))' 



The formula ( 11091 ) then takes the form — 
which implies the equilibrium form 

1 S(A t (x t ))' 



k=o = d s ((PH-l)(x s )A t (x t )), 



P Sk s 

In particular, we obtain the usual FDT for the energy 11781 
1 S(H(x t ))' 



= d s (H(x s )A t (x t )}. (115) 

h=0 



P 8k s 



= d s {H(x s )H{x t )). (116) 

k=0 



6 Two families of non-perturbative extensions of the Fluctuation-Dissipation 
Theorem 

It is well understood since the discovery of the FR that they may be viewed as ex- 
tensions to the non-perturbative regime of the Green-Kubo and Onsager relations 
which are usually valid within the linear response description in the vicinity of 
equilibrium f3~6 l57| . A detailed proof was given in itTTTl that the Jarzynski equal- 
ity gives the usual FDT when expanded to second order in the response field. In 
1121 . it was proved that this correspondence is still true around an unperturbed 
state which is stationary but out of equilibrium) . This is proved by doing a Taylor 
expansion of a special Crooks theorem to first order in the response field. Finally, 
in lfl4H . general FR were exhibited which are global versions of the GFDT for 
nonequilibrium diffusion, or, of the FDT for energy resulting from a thermal per- 
turbation. We introduce in Section ( 16.1b a first family of exponential martingales 
which is a natural object associated with the perturbation ( 176b . and show in Sec- 
tion ( 16.1.31) that these are global version of general GFDT ( 191194b . Section d6!2l 
presents the martingale property of functionals which appear in the fluctuation 
relations and it shows their relation to the exponential martingales introduced in 
Section ( 16.1b . Along the way, we prove the FR along the lines of the proof given 
below for the exponential martingale by a comparison to the backward process 
generated by the Doob ft-transform of the adjoint generator V . 



6.1 New family of exponential martingales naturally related to GFDT 
6.1.1 Introduction 

We come back to the perturbation d76b of the generator, 

L; = K X oL t oh t - h; x L t [h t ] , (117) 

but this time we will not restrict to the regime where h, is infinitesimal. We prove 
in Appendix (0 that the Markov process associated with the generators L\ l and L t 
are related through the functional exp(— Z' ,,r ) by 



/f'i.v.v! K., <S(A-,-y)exp(-Zf) 



(118) 
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where 



exp(-Z*' f [*]) = h s 1 (x. s )exp ^- ^ (/z„ 'l,,, [/»„] +ft H l d u h u ) (x u )\ h,(x t ). 

(119) 



The functional exp(— zj ') is multiplicative: 



exp(-Z*>) = exp(-Z^) exp(-Z^) (120) 



for s < u < t. The perturbation dl 17b is a particular case of the transformation of 
a Markov process by multiplicative functionals [7 145]. It is a generalization of the 
Doob /t-transform, which is 

PF(x,y)=hJ 1 (x)F t ,(x,y)h t (y), (121) 

in the case where h t (x) is the space-time harmonic function, i.e. ^4-^ = 0. 



Thanks to the Markovian structure of the trajectory measure, the relation dl 181 ) 
for the transition probability is equivalent (as proved in Appendix[F]l to the relation 
between the expectations of functionals of the paths from time s to time / for the 
perturbed and the unperturbed processes, 



(122) 



where E' 1 k [ ] denotes expectation for the process with generators Lf. 

Finally, we can also formulate dl22b by requiring that the perturbed process 
with generators L 1 ^ and trajectory measure Af^ ^ ,^"1 can be obtained from the 

unperturbed process with trajectory measure M^ g r^i by using the likelihood ratio 
process (the Radon-Nikodym density): 

< M W =^oMW^(^)ex P (-Z^M), (123) 

Ps 

with ps(x) = J dypo(y)PQ(y,x) the instantaneous density of the original process 

and Ps(x) = j dypo(y)PQ S (y,x) the instantaneous density of the /j-transformed 
process. 

We could not find the general result dl 19112211231 ) in the mathematics liter- 
ature, but many very closely related results do exist. The subcase of dl22U23l) 
where h t is time-homogeneous (i.e., d t h t = 0)) was treated long time ago by Ku- 
nita in lf54l and was revisited recently in the articles f74l and |26l . In our context 
of the FDT, the extension to d,h t 7^ is essential. But more than generalizing to 
d t h t 7^ 0, the main interest in the Appendices dEIFI ) is to prove d!22l ) from theoret- 
ical physics perspective. We recall also that for a diffusion process, the perturbed 
generator dl 171 ) is obtained by adding the term d,V (lnh t (x)) to the drift (see d81b ). 
Then, the proofs in Appendices dEIFI) are also a theoretical physicist's proofs of 
the Girsanov theorem for a diffusion process H77I (for this type of change of drift). 

10 Note that the measure Ho(dx) = po(x)dx is the measure at initial time t = and not at time 
s. 
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6.1.2 Martingale properties of the functional exp(— Z' ) 



The multiplicative functional exp(— Z,' r [x]) is an exponential martingale with 
respect to the natural a-algebra filtration ^ t — a(x s ,s < t) representing the in- 
creasing flow of information. This fact can be seen by first noting that (1122b (with 
F = 1) implies the normalization condition 



exp ( -Z h / [x] 



= 1, 



(124) 



which, thanks to the multiplicative structure of exp(— Z?' ? [x]), yields 



E 



exp(-Zf \x])\& u =exp(-zr [*])E*, 8 exp(-Z^ ; [x]) = exp(-Zf [*]), 

(125) 



for s < u < t. 



6.1.3 Fluctuation-Dissipation Theorem as Taylor expansion of the exponential 
martingale identity M22\ 

In the infinitesimal case, h t (x) = 1 + k,B,{x) + 0{k 2 ), Taylor expansion of the 
subcase of (1122b with one-point functional Fuj [x] = A t (x t ), namely, 

(A,(x,)) h = (^(h s y l (x,)exp f jf du {-h~ l Lu [h u ] - h~ x d u h u ) (x u )j h 1 (x t )A t (x t )\ , 

(126) 

gives, to the first order in [k], 



(A t (x t )) h - (A t (x,)) - ((ft,)" 1 (x s )At(x t )) - ((*,) 

+ J/ u (^( x «)Mxt))+0(k 2 ) = 0. (127) 

To find the first GFDT d9Tb from ( 1127b . we use the direct differentiation for- 



mula d+h " — d +( k " B "'> 
mula ~dT - — W, — 



{d u k u )B u + fc» rf+ Jf"^ obtaining the relation 



d u (B u (x u )A t {x,))- 



k=0 



d+B„ 



du 



u -{x u )A t {x t )) =Q, (128) 



which is the GFDT ( 1911 ) (note the equivalence of the two notations ( )' and ( )' ! )). 
To find the second GFDT ( 194b from J127I) . we use the formula d+ = 2d — d-, 
which gives 

(A t (x,)) h - (A,{x,)) - (ih s )-' (x s )A,(xt)) - ((h t ) {x,)A t {x,)) 

dh L 
du 



I ( dul ^-(x u )A,(x, 



' du (iJbL( Xu )A l {x t )) + O(k 2 )=0. (129) 



du 
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Then, by using ( 135b for the time derivative of a correlation function, we obtain 

(A,{x,)) h - (A,{x t )) - {[h s y x (x s )At(xt)) - {{h,) (x t )Mx t )) + 



t I dh u \ f* 

dU \~du ^ V ~~ J d Ud " ^ ^ ^ + 



O(k 2 )=0. (130) 



Next, we use the differentiation formula =t£ = 



dh u _ d(k u B u ) 



du 



= (d„ku)B u +k u ^ to get 



S(A t (x r ))' 



8k u 



k=0 



-2d u (B u {x u )A t {x t ))+2{—±{x u )A t (x t ) ) = 0, 



which is d94t . This gives a second independent proof of d9Tl [94b . It also shows 
that the above exponential martingales are natural global versions of the GFDT. 
We will discuss in the next section another well known global version, namely, the 
Fluctuation Relations (FR). 



6.2 Family of exponential martingales related to GFDT through Fluctuation 
Relations 

6.2.1 Introduction to Fluctuation Relations 

Roughly speaking, FR may be obtained by comparing the expectation of func- 
tional of trajectories of the system and of reversed trajectories of the so-called 
backward systerrQ (denoted by an index r) . More precisely, let us denote by 
M''^ j T j the trajectorial measure of the backward process which is initially dis- 
tributed with the measure Ho(dx) = pQ(x)dx. Next, we define the path-wise time 
inversion R at fixed time 70 which acts on the space of trajectories accord- 
ing to R[x} t = [x} T _J^\. This allows us to introduce the (push-forward) measure 
R* (^fjo,[0,r]) ' which is the measure of the trajectory but traversed in the backward 
sense. We then introduce the action functional Wq through the Radon Nykodym 
derivative of the image measure of the backward system {M^r j with re- 
spect to the trajectorial measure rgj] of the forward system (initially dis- 
tributed with the measure Ho(dx) = Po(*)(£k){3 

R* { M km) ^ ex P(- w o)^o,[o,r]- (132) 



It is important to underline that this backward process is not unique. We can also call it a 
comparison process 

12 This was also studied in the probabilistic literature, but with time T that could be random 

ED 

13 For simplicity, we neglect the case where the time inversion acts non-trivially on the space 
by an involution. Such a situation arises for Hamiltonian systems (see II 11 ) where the involution 

is (q,p) -> (q,-p). 

14 We assume that the measures M^ [ 0i 7j and R„ (m 1 ^, | are mutually absolutely continu- 
ous. 
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Equivalently, we can write this relation in the form of the Crooks theorem 
[T9ll57ll42lfTni60ll81ll asserting that for all trajectory functionals Fp 

(Fpj] oR) r = (Fp >T] exp (-Wj)) . (133) 

Finally, by the substitution Fpj^ [x] — > Fp^j [x] 8(xq — y)}8(xT — x), we find the 
equivalent relation, 

Po'WE^ [Fp tT] oR[x] 8(x T -y)] (134) 

= p (y)E , ) , [F m Mexp (-Wj [*]) <5(x r -*)] . (135) 

Due to the freedom in choosing the initial forward measure po or the backward 
measure /Jq, it is possible to identify the action functional with various thermo- 
dynamic quantities like the work performed on the system or the fluctuating en- 
tropy creation Oq [x] with respect to the inversion r . This latter quantity is ob- 
tained when ^{dx) = p^{x)dx = pj(x)dx = J dypo(y)PQ (y,x)dx. We can also 
obtain the functional entropy production in the environment, jX, by choosing 
jJ.o(dx) = ^{dx) = dx, because then the difference from the entropy creation is 
the boundary term In (po (xq ) ) — In (p, (x t ) ) , which gives the change in the instan- 
taneous entropy of the process. 

Let us observe the similarity between (112211231 ) and (11351132b ; exp(— 1 S ' [x]) 
and exp(— Wq [x]) are exponential functionals of the Markov process. However 
exp(— Wq [x]) is not a forward martingale in the generic case because ( 11351 ) im- 
plies that 

Eo4exp(-W-)] = ^M^!M. (136 ) 

Moreover, 

exp(-Wg)(y) = ^ (137) 

and then Eo, v [exp(— Wq)] 7^ ex P( — Wq)(v), except in the case where p' Q is an 
invariant density of the backward dynamics. The fact that exp(— Wg [x]) is not a 
forward martingale does not prevent us from obtaining the Jarzynski equality 11191 



<exp(-W5)) = l, (138) 

which is a direct subcase of ( 11331 ). We will show in the next section that there is 
nevertheless a martingale interpretation of the action functional and the Jarzynski 
equality is one of its consequences. 

The Jarzynski relation d 1 38b implies two important results. First, the Jenssen 
inequality allows to obtain the Second Law of Thermodynamics, 

<Wj)>0. (139) 

Second, the Markov inequality 11291 gives an upper bound on the probability of 
"transient deviations" from the Second Law: 

P (exp (-Wj) > exp(L)) < ( ex P(~^o) ) then p ( Wj r < _q < exp . 

(140) 
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6.2.2 Martingale properties of the action functional 

We noted in the last section that the functional exp(— Wq ) is not a martingale 
with respect to the time T of inversion. In order to unravel its links with the mar- 
tingale theory, we shall define a functional similar to Wg , but with a lower time 
indices different from and a upper time indices different from T. This will be 
done through the comparison of the trajectorial measure for the forward 

system on the subinterval [s,t] of [0, T] and the push forward by the time inversion 

R * i^li r [T-t T-s]) °f tne trajectorial measure for the backward system on the sub 

interval [T-t,T-s^ 

R * (m^t-^t-s]) =exp(-WQM fl0iM . (141) 

Proceeding as in the last section (1133b . we can write the Crooks-type theorem 
for all functional Fr^i of the trajectories from s to t, 

(F [s , t] oR) r = (F [sA exp{-W t s )), (142) 

or, equivalently, 

p r T _ t {xW T - t , [F[sA °R[x]S(x T - s -y)] 

= p s (y)E Siy [F M [x]exp(-W i s [x\)S(x t -x)], (143) 

with p r s (x) = Jdyp{,(y)P{j s {y,x) and p s (x) = J dyp Q (y)P${y,x). Finally, this 
includes also a Jarzynski type relation d!38lP^ : 

(exp(-W')) = l. (144) 

For studying the martingale properties of exp(— W' s ), it is important to note 
that this functional is not strictly multiplicative. For < s <u<t <T, the Markov 
propertied imply the "multiplicative" law for the action functional: 

exp (-W* [dx]) = exp(-W? [dx])acp (-W'„ [dx]) ~^-{x u ). (145) 

Pt-u 

15 Then the two measures deal with the "same part" of the trajectory. 

16 Note that exp(-W*)(y) = PT p ~(^ and mis seems to contradict ( 11371 in the limit s -> 0. The 
resolution of the paradox is that expression here is obtained by the limit at fixed T: limlimWJ,, 

while (137} results from a different limiting procedure: lim limWr. 

r->Oj->o 

17 

. , M^ [SJI] [dx]M^ [lu] [dx] 

M ^*\^ = jjgfc • 



and 



* K r ■ r ,) W - t (Wi)H'fc.,->l 

V W' '■' S \J p' T _ u (x u )dx u 

where the right hand sides describe the disintegration of the left-hand-side measures with respect 
to the map evaluating trajectories at time u. 
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This allows to introduce two functionals, 

[dx] = -^(x s )exp (-W' s [dx]) and R' s [dx] = exp (-W' s [dx]) -y-(pc) 
Pt-s Pr-t 

(146) 

with the strict multiplicative property: 

K=KK and R'=R%. (147) 



For these two functionals, the relation dl43l ) implies that 

E, v [A' s [x] S(x t -x)] = ^^fT- t , [S(x T - s -y)} , (148) 

and 

E s , y [R' s [x] S(x t -x)] = ^E' r _ ; , [8(x T -,-y)] , (149) 
yielding the Jarzynski-type relations, 

Es,y[K] =1. (150) 

and 

(R' s [x}S(x t -x))=p t (x), i.e. E(R' s \x t =x)=l. (151) 

Then, by using the multiplicative property ( 11471 ) and the relation (1150b , we see 
that R' s is a forward martingale with respect to the natural filtration J£> , : 

E[A<|J? H ] =A U S , (152) 

for s < u < t . Similarly, by using the multiplic ati ve p roperty dl47b and the relation 
(1151b . we see that R' s is a backward martingalq3 with respect to the filtration 
<g s — a(x v ,v > s) which describes the future of the process, 

E[Ri|Sf„] =R[ n (153) 

for s < u < t. From the definition ( 1146b . we deduce that the action functional 
exp (— W' s ) with 0<i<M</<risa forward martingale with respect to upper 
indices and a backward martingale with respect to lowest indices s. 

This gives a martingale interpretation of the Jarzynski equality (11381144b . One 
possible application is to improving the upper bound of the probability of "tran- 
sient deviations" of the Second Law. The Doob inequality 1124 11291 for forward 
martingales gives a stronger upper bound than the Markov inequality ( 1140b . 

Pf -p (exp(-WO)>exp(L))<^_^l), (154 ) 

\ t with 0<s<t<T ) 



exp(L) 



and then we obtain the relation 



P inf W'<-L <exp(-L) . (155) 
\t with 0<i<r<7- 



18 A backward martingale (24J29) is dual to forward martingale, in the sense that its expecta- 
tion in the past, given the knowledge accumulated in the future, is its present value. 

19 This is a little tricky because we proved in the last section that exp (— Wj) is not a forward 
martingale with respect to T. What happens for t = T is that a change of T implies also a change 
of the time inversion R which breaks the martingale property. 



35 



6.2.3 Action functional Wj and the time reversed process 

It is proved in the probability literature II16II31II34II44II69II70H that the time-reversed 
process, RX, = X,* (with t* = T — t), is also a Markov process. By using the results 
of Section f22\ and more specifically, the expression of the cogenerator, ( 1181) . we 
can deduce that the Markov generator of the time-reversed process is 

Lf R = L*< ee p- 1 o4 op* - p-% [p t *\J. (156) 

Choosing this process as the backward process was called complete reversal in 
lllll . and this explains the index "CR" on the left hand side. We remark that the 
instantaneous density of the time-reversed system is related to that of the original 
system by pf R = p t * . Denoting by Af^jf f j the trajectorial measure of the time 
reversal of the backward process initially distributed with the measure Pg, we 
have the tautological formula: 

R *{ M k[T- t J-A)= M S-A- (157) 

This allows to obtain an expression for the action functional W' from (11411) with- 
out push-forward : 

M S,t]=™P(-W's) M ^]- (158) 

This expression will be used in the next section, but it also allows an easy proof 
of the assertion that exp (— W' s ) is a forward martingale in / and a backward mar- 
tingale in s. 

6.2.4 Class of action functional W' s M41\ which are in relation with the 
exponential martingale Z' s U19i 

We consider here the case where the backward process is given by the generalized 
Doob /-transform of the adjoint generator composed with an inversion of the 
time: 

1$ = Z" 1 °4 of u - f-% [/„] ; u* = T u. (159) 

We shall denote by W{'' the action functional associated with this choice of the 
backward process. 

Using the definition of the total inversion J156I ) and after some algebra, one 
may show that 

{L[/) CR = (p^y'fuoL.op^f- 1 - (p^-'fuLuip^f- 1 ]^. (160) 
So, for h u = p r u *fu l , we have 

W) CR =L h u , (161) 
upon using the definition of the generalized Doob /z-transform ( 1761 ). 
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Finally, by comparing the relations ( 11581) and ( 11231) . we find the link between 
the two families of functional^!: 

exp (-W{>') = ^(x f )exp (-Z h A , (162) 

Ps ^ ' 

with h u = p r u *fu { - Moreover, this relation allows to obtain from ( 11191 ) an explicit 
expression for exp ( -Wj 



exp(-W{'<) = ^-Wexp (- jyu^LM+h^dJiu) (x u )\ h t (x t ) 
= ^(x,)exp (- f du^LM+h^duK) (x u ) ) f£-(x,) 

Ps \ Js J ft 

= £fe)exp (-£du(f- l Ll [f u ]~f~ l (d u f u ))) (163) 

with, as before, p s (x) = / dyp {y)P° (y, x) and p£ (x) = J dyp' Q (y)P r / {y, x jB 
In particular, the action functional with s = and t = T, which results for the 
choice po = fo and Pq—/t, is then 



W f / = £ du {f~ l Ll \f u ] - f- 1 (d u f u )) , (164) 

The form ( 1159b taken for the backward generator may be justified by showing 
that it allows to recover the forms of time inversion usually taken in the probability 
or physics literature. 

- First, we remark that the usual Doob /-transform corresponds to the case 
where we take for f t the PDF ([8]) of the forward process (i.e., d t f t —V t .f t = 0). 
Then, we recognize using formula ( 118b that L[* = L* t and then this backward 
process is the one obtained from the original one by the "complete reversal" 
considered in Section ( 16.2.3b . This implies with d 19b that 

if =*$ Q'du(K)^ (p«(L^) f ) 

r*^(oV=(<' cR ) f - d65) 



t* 



20 Note that pj' = p r s , 

21 The last equality in d 1 <53fc results from the following algebra: 

K l d u h u = (p' u ,y [ f,,d u {p' u ,f- 1 ) 

= -K l d u f u + {p , u ,r i Mp' u *) 

= -f^d u f u -(p:,)- l {i^y[p:,] 

= -K l duf u +f7 l L\ [/„] - ( P ;,r' fuL u \p r u ,fu\ 
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Finally, with ( 116b . we obtain the generalized detailed balance, 

p s (x)Pl(x,y) = Pt (y)P?:' CR (y,x). (166) 

One may show that pf R = p t * is the instantaneous density of the backward 
process and that the corresponding current operator ( 120b satisfies the relation 

jf R = -J? , (167) 

which is very satisfying physically. This choice, however, corresponds to the 
vanishing of the functional W' s and of the entropy creation (equal to it due to 
the choice p£ R = Pt)- 
- Another useful choice of time inversion, called the current reversal in H X 01 
[TTl . is based on the choice f t = n, , where n t is the accompanying density 
d 13b . One can show that 7tf = K t * is then the accompanying density for the 
backward process. If we associate with the accompanying density the current 
operator, by analogy with ( 120b , 

J, = n t o L, - l) on t , (168) 

we can easily show that still J[ = —J t *. The functional ( 1163b now takes the 
form 

exp(-W(=*> f ) = ^(*,)exp (J^duidubM*) (*„)) (j^j ' (x t ). (169) 

Moreover, the choice of initial density Po = TTo and and p' Q = n' Q = n T , implies 
that 

T 

W f =7lJ = - I (d u lnn u )(x u )du ee W T Q ' ex , (170) 
o 

where the index "ex" stands for "excess" 111 1173 IIBTfl . The Jarzynski equality 
d 138b for this case was first proved for a one-dimensional diffusion process in 
l43l and then for Markov chains II15II37I . general diffusion processes 111 111601 . 
and pure jump processes 11611 . We see here that these FR are true for general 
Markov processes, including stochastic equation with Poisson noise ( 152b or 
with Levy noise. This is an optimistic result for the generality of FR in the 
context of the proof in [87 61 that the Gallavotti-Cohen relation for the work 
is broken for a particle in a harmonic potential subject to a Poisson or Levy 
noise. Moreover, in the case of the jump Langevin equation (1631 ), we have 
the normalized accompanying density % t = exp(— j3 (H, —F t )) (where F, is the 
free energy) and then 

T 

W^ v = j8 J (d u H u )(x u ) du-P (F T - F ) . (171) 
o 

So, in this case, the finite time FR ( 1133b for the dissipative work performed on 
the system is valid. 
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- For diffusion processes, it was shown in 1111 that to obtain a sufficiently flex- 
ible notion of time inversion, we should allow for a non-trivial behavior of the 
modified drift u, (see Hill ) under the time-inversion by dividing it into two 
parts: 

u t — Ut,+ +u,-. (172) 
Here u t + transforms as a vector field under time inversion, i.e., SJ* , = + Ut,+, 
while Uf — transforms as a pseudo- vector field, i.e., m|* _ = — u t _ . The random 
field Tji may be transformed with either of the two rules: T] r r * — ±T] f . It can be 
shown 1141 that the choice of the vector field part which allows us to obtain 
the backward generator given by ( 11591 ) is 

$,+ = |v(ln/ f ). (173) 

This is the choice made to obtain formula (22) in 1141 in order to find FR that 
are global versions of GFDT in the context of a Langevin process, and we find 
dT64l as formula (24) in lfT4l . 

6.2.5 Fluctuation-Dissipation Theorem as Taylor expansion of fluctuation 
relation for the class of functional exp(— w{'') 

For completeness, we recall here the proof, done in 11411 for a diffusion process, 
that the family of FR (1133b with ( 1164b are also global versions of the GFDT 
(191194b . More precisely, they are global versions of the fundamental relation of 
the linear response theory d75l ) which, as explained in Section (15.3b . implies the 
GFDT (ED Eg). 

For the dynamics of the perturbed systems ( 1761 ). we consider the fluctuation 
relation (1133b with the functional (1164b written for f, (with f (x) = 1 + k t A t (x) + 
0(k 2 )) as the mean instantaneous density p t of the unperturbed system (with / = 
1 = k = 0). The functional ( 1164b becomes 

W ° T = Jo ks ( Ps ~ lN ° ^ ^ dS ' (1?4) 
where N is defined in (l74l . Let us now write a particular case of ( 1133b for a single 
time functional F[x] = A a (x t ) = Af (0 < t < T): 

(A, exp (-W£' T ) ) f = (A T _ t ) f - r . (175) 

The first order Taylor expansion, 

exp(-W£ T ) = 1 + f k s {{p s - x N}{p s }) (x s )ds + 0(k 2 ), (176) 

J 

in ( 1175b gives the relation 



fe=o {A t ) f ds - I k s <pr 1 iV t [p,](x,)A,(x ( )>* + £/{k 2 ) 

= (A T „ t ) f ' r . (177) 



Due to the form of the considered inversion ( 1159b . the right hand side has a func- 
tional dependence only on {kj-_ u ,T — u < T — t}, i.e. on {k u ,u > t}. So, if we 
apply ^|-|fc = o for < s < t to the last identity, we obtain the relation J75I ). 
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7 Conclusions 



We have shown that the kinematics of a Markov process, namely, the local ve- 
locity ( 125126127b and the derivatives ( 1281 ). allow to develop a unified approach to 
obtain recent GFDT in the context of fairly general Markovian evolutions (Section 
( 15.31 )). We have also elucidated the form of the usual perturbation ( 176b used for 
FDT by showing its similarity to the Doob /z-transform well known in the prob- 
abilistic literature. We also presented examples where the physical perturbation 
is more general, e.g. given by a time change dl 10b or by a thermal perturbation 
(Section (I5A31 V). We derived the GFDT for these examples (1111111210161 ). In 
this paper, we have also presented a class of the exponential martingale function- 
al (11 19b , which represents an alternative to FR as a non-perturbative extension 
of GFDT (Section [6.1.3l ). Moreover, we established in Section 6.2.4 a direct link 
between this family of functionals and the FR. We showed that the FR also in- 
volve a family of martingales which for a fairly general class of FR, including 
several classes discussed in the literature, coincides with exponential martingales. 
This class of FR was obtained by comparison of the original Markov process to 
the backward process whose generators ( 11591 ) are generalized Doob transforms for 
the adjoints of the original generators. In the process, we improved the classical 
upper bound for "transient deviations" from the Second Law ( 1155b . Our hope is 
that, despite lack of rigor from the mathematical perspective, this article will serve 
as a bridge between nonequilibrium physics and probability theory. 
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A Proof of the relation (f35) 

By taking the derivative of the relation <34t with respect to t (> s), we get 

d,(U s (x s )V t (x,)) = J dxdyU s {x)p s {x)(d t P t s {x,y))V t (y) + J dxdyU s (x)p s (x)P' s (x,y)(d t V t {y)) 
= (U, (x s ) (d,V, +L,(V,)) (x,)> = (u, (x s ) ^ (*) \ . 

In deriving the second line, we use the forward Kolmogorov equation $5\). Now, by taking the 
derivative of <34t with respect to s (< t), and by using the definition of the cogenerator (19), we 
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get 

d s (U s (x s )V t (x,)) 

= [ dxdyU s (x)(d s P:'(x,y))p,(y)V,(y) + J dxdy(d s U s (x))P;<(x,y) Pl (y)V,(y) 

r dxdyU s (x) ((L*) f if ) (x,y)p,(y)V,(y) + J dxdy{d s U s (x))P?{x,y)p t (y)V t (y) 
= -j dxdydzU s (x)L:(z,x)P;>(z,y) Pt (y)V,(y) + J dxdy(d s U s (x))P:< (x,y)p,{y)V,{y) 
= -J dydz(L:u s )(z)P;>(z,y)p,(y)V l (y) + J dxdy(d s U( S ,x))P; s (x,y)p t (y)V t (y) 
= {{d s U s -L*U s ) (x s )V, (x,)} = (^-^ (x s )V, (x t ) 

B Proof of the relation ( l47t 

The formal adjoint of the generator <42t of a diffusion process is given by 

L t = _ v ,o^ + iv,-o4"'oV ; , 



So, for all functions f, in S , we can express the operator /, 1 oL] of, as 

= fr 1 ° (- V, o % + I V, o 4"' o Vy J o /, 



= /r 1 ° (- ( V « ("»/») ) " <4ft ° V, + \ V, o (V;/, ) + f,di> oVjJ 
= /r'i/l./;] +A -2R-f (V,ln/ ( ) ) V,, 



2 

Moreover, with /, = p, (PDF {8]i) and with {9}, we obtain 

p,-' olj op, -p,- 1 (d,p,) = U -2 U - (V,lnp,) j V,, 

By using the definition of the cogenerator dTst and of the hydrodynamic velocity J451 . we 
obtain the formula l l47t . 

C Proof of the relation (l75l 

We start with the first-order Dyson expansion 1501 of the ordered exponential : 

z*$(^f du(L u + k u N u )\=^i(j duLu\+J dsexfa^J duL^j k s N s ex$ fj dsL.^j +0(k 2 ). 

Then, for the one point functional, one has 

(At {*))' = J dxdyp (jc)i3 (x, y)A, (y) + J dsk s J dxdydzdz' po {x)P s (x, y)N s (y, z)P l , (z, z')A, (z') + 0{k 2 
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The response function is then given by 

S<Al Jf l)) ' = j dxdydzdz' Po {x)P^x,y)N s {y,z)P , s {z,Z r )A,{z') 
= J dydzdz'p s (y)N s (y,z)PUz:z')A l (z') 
= fdzdz\N]p s ) (zjPffc^CO. 

which is <75t . 

D Proof of the relation ((80) 

With the formula <42t for the generator of a diffusion process, and for two arbitrary functions / 
and g on S, one has 

h [fg] = s{ v, [/g] + 1 (v, o o v 7 ) [/ g ] = M (v,g) + s< (v,/) g + 1 v, (v ;/ ) g + (v ;g ; 
= /sj ( v,g) + s< (v,/) g + I (v, (d^Vjf) ) g + 4' (Vjf) ( v,-g) + £ (v, (dp v jg ) ) 

= /L,(g)+L,(/)g + rf;''(V,/)(V ; g). 
We then obtain the formula {80} for the operator "carre du champs": 

r,(f,g)=d i /(v i f)(v J g). 

E Proof of the relation (ITT8> 

We start by proving the operatorial relation 

if' = h- l ^$(£du (L„ - h- 1 L„ [h u ] - K 1 d„/i„) J h, . 

First, it is easy to see that the above relation is true when t = s (also, then both the left hand 
side and the right hand side equal the identity). Moreover, we now show that the two sides of the 
relation verify the same differential equation. For example, the right hand side satisfies 



h s "exp" ( jf du(L u -h u l L u [h u ]-h u x d u h u )\ h, 
= h; [ e$ (jf du (L„ - h; [ L„ [h u ] - h-'dji,)^ o (L, oh, - L, (h,) - d,h, + d t h s ) 
= (Ve^ ^du(L u -h-'L u [K]-K l d u K)\ h^j o (V 1 °L, oh, - h; l L,(h,)) 
/^'exp - fjf du (L„ - h~ ] Ly [h u ] - h~ ] d u h u j\ hA oL*. 



It is easy to see by using the forward Kolmogorov equation th at the ri ght hand side verifies the 
same equation. Now, we can a pply t he Feynman-Kac formula 1771851 to the right hand side of 
(TEJ, and we obtain the relation Q 1 8t . namely, 

/f'(*,y) =E^ (8{ Xi -y)exp(-Zj J [x] 

with the functional exp(— Z' s [x]) given by the relation d!19t . 
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F Proof of the relation (1122 



We now want to prove the relation d!22b with F an arbitrarily functional of the trajectories on 
[s,t] . It suffices to check this identity for the so-called cylindrical functional: 

F[ s j][x] = F(x s ,x h ,x tl , ...,x tn ,x t ) fori <t\ <t 2 < ... <t„ <t. 

We will use the Markov structure of the trajectory measure. 

^[F{x s ,x h ,x t2 ,...,x tn ,x t )\ 
= j dxidx 2 . . .dx„dyF (x, X\ , x 2 , x„,y)P* fy (x, dx\ )P*'' 2 (x\,dx 2 )~ J$f (x„ , y) 

= j dx\dx 2 . . .dx n dyF (x,X\ ,x 2 , . . . , x„,y)h~ 1 (x) 



xE,,.. v 



h h {x\)h t l (xi) 



h,{y) 



8{x h -xi)exp l-J du{h~ l L u (h u ) +h~ l d u h u ) 
8 (x, , - x 2 ) exp ( - J du( h~ 1 L u (h u ) + h~ 1 d u h u ) 
S(xt-y)expf- jf du (h~ 1 L u (h u )+h^ [ d u h u ] 
= J dx\dx 2 ...dx„dyF(x,xi,x 2 ,...,x n ,y)h~ l {x)E s . x 8{x h -*i)exp (- jf du(h~ l L u (h„)+h~ l d u h u ) 
8(x tl -x 2 )exp(- £ du (/r t 7 1 L u (h u ) + h~ l d u h u )\ 
8(x,-y)exp {- J t du ( h u ' L u {K )+h~ ] d u h u ] 
F(x s ,x tl ,x tl ,...,x,„,x,)hJ 1 (x s )<zap f-jf du(h^'L u (h u ) +h^' d u h u )^j h,(x, 

= E. ! ,[F [ .,, ] exp(-Z';-'[x])]. 
We thus arrive at (122). 



xE 'i,-v 
xE v.v 
= E„- 



h,{y) 
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